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(57) A file ot digital color data representing a color 
image is transformed into a new file of digital color data 
where one or more colors have been transformed to one 
or more new color locations where their reproduction is 
known to be preferred. The digital color data is provided 
in a multi-dimensional color space where the color loca- 
tions to be operated on in the color space are designated 
as color magnets. The color space distance is then cal- 
culated between the color locations of the digital color 
data in the color space and the color magnets. A partic- 
ular activity is prescribed for each color magnet that af- 
fects nearby color locations in the color space; this ac- 
tivity includes one or more activity selected from the 
group including attraction, repulsion, shielding and 
dragging. Then, the digital color data is mapped to new 
locations in the multi-dimensional color space as a func- 
tion of the color space distance and the selected activity, 
wherein the degree or strength of activity is a function 
of the color space distance or direction in color space. 
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Description 

[0001] This invention relates to the field of digital image processing, and in particular to the field of color image 
transformation. 

s [0002] In designing color Image capture and reproduction systems, it is Important to be able to render colors In an 
optimal manner such that they are most meaningful, appropriate, natural, and pleasing. Various modes of color repro- 
duction are applicable in different color reproduction applications. For instance, a color image in a fine art publication 
may we!) be judged in terms of the accuracy of color appearance of the reproduction relative to the original artwork. 
Images intended for advertising may be judged in terms of the colorimetric accuracy of the reproduction of certain 

10 trademark colors against an aim. Color reproductions of analytical test charts such as the Macbeth™ color checker 
are judged relative to the spectral accuracy of the reproduction patches compared to the objects those patches rep- 
resent. Pictorial images are generally judged against more arbitrary standards. Images used in commercial applications 
often have their chromas boosted, making them more appealing and attention grabbing. Professional portrait photog- 
raphers will always print skin tones that flatter the subject rather than provide the most accurate rendition. Personal 

15 photographs, or snapshots, are frequently judged relative to a memory of how the original scene appeared. These 
memories are seldom "colorimetrically accurate" and are frequently influenced by color preferences of the customer, 
particularly for the so-called memory colors including sky, foliage and skin tones. 

[0003] A comprehensive discussion of color rendition can be found in R. W. G. Hunt, The Reproduction of Colour, 
5 th Edition ,, Fountain Press, pp. 223-242 (1995). Hunt describes how color images can be reproduced in a range of 
20 different ways, to achieve a number of different objectives. In each case, however, observers judge the color quality 
of that reproduction according to their intended use of the image. Hunt has identified six distinct modes of color repro- 
duction that cover all applications of color reproduction from entertainment to scientific. 

• The most demanding mode of color reproduction is "spectral reproduction". This is where the spectral reflectance 
25 (or transmitiance) of the reproduction matches that of the original. In this case the reproduction and the original 

will match in appearance regardless of changes in Hluminant for any observer. Spectral color reproduction is seldom 
achieved in practice and is not commercially viable as a means of image reproduction. 

• In "colorimetric color reproduction" the chromaticities and relative luminances of the original and reproduction 
match for a defined viewing Hluminant and a defined standard observer. Since color appearance is not independent 

30 of viewing Hluminant intensity, colorimetric reproductions do not match originals in color appearance for large in- 

tensity changes. 

• "Exact color reproduction" occurs when the conditions for colorimetric color reproduction are met and, the absolute 
luminances of the reproduction and original match. The original and reproduction will match In appearance for a 
standard observer under identical conditions of visual system adaptation. 

35 • |f a reproduction is to be viewed under different conditions of adaptation than the original then a color appearance 
match can only be achieved if adaptation factors are considered and accounted for In the mode of reproduction. 
This is the case with "equivalent color reproduction". This is very difficult to achieve in practice because the color- 
fulness of objects seen under bright daylight usually cannot be reproduced under artificial Hluminant viewing con- 
ditions. 

40 • in "corresponding color reproduction" the objective is to reproduce an original scene as it would appear if it were 
viewed under the reproduction viewing conditions. 

• The final mode of color reproduction is "preferred color reproduction*. In this mode the reproduction colors are 
rendered to match the preference of the observer. These preferences will tend to vary from observer to observer 
but there are general, quantifiable preferences that exist across most observers that can be included in a color 

45 reproduction. 

[0004] In addition to the Hunt book, there are a number of publications in the technical literature that refer to the 
importance of preferred colors and concept of key memory colors In the art of rendering natural images. For example, 
C. J. Bartleson , "Memory Colors of Familiar Objects," Journal of the Optical Society of America, 50, pp. 73-77, (1 960); 

50 p. Siple, and R. M. Springer, "Memory and Preference for the Colors of Objects," Perception and Psychophysics, 34, 
pp. 363-370, (1983); S. Sanders, "Color Preferences for Natural Objects," Illuminating Engineering, 54, p. 452, (1 959); 
and R. W. G. Hunt, I. T. Pitt, and L. M. Winter, "The Preferred Reproduction of Blue Sky, Green Grass and Caucasian 
Skin in Colour Photography," Journal of Photographic Science," 22, pp. 144-150, (1 974). It is evident from this literature 
that, for some objects whose colors are well-known, preferred color reproduction may be advantageous, wherein de- 

55 partures from equality of appearance (whether at equal or at different absolute luminance levels) may be required in 
order to achieve a more pleasing rendition. 

[0005] As a consequence, imaging and photographic companies have intuitively understood the benefits of preferred 
color rendition for many years and have attempted to achieve some measure of customer preference through careful 
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manipulation of the characteristics, including tone scale, interimage and spectral sensitivity, of the photographic system, 
In contemporary imaging systems, preferred color rendering is often accomplished through the use of some form of 
preferred color mapping. For example, U.S. Patent No. 5.5B3.666 describes a method for transforming an input color 
space to an output color space using a transform. In particular, a computer graphics morphing technique is described 

5 wherein the explicit constraints are comprised of points residing on the gamut boundary of the input and output color 
spaces. Although this method produces a smooth output rendition, it is limited in terms of the constraints it can impose 
on the color space transformation. An arbitrary point in the color space cannot be moved to another arbitrary position 
in color space. A group of patents issued to Buhr et al. (U.S. Patent Nos. 5,528,330; 5,447 811; 5,390,036; and 
5,300,381) describe color image reproduction of scenes with preferential tone mapping for optimal tone reproduction 

10 in color photographs. In this series of patents, the image reproduction is modified by a scene parameter transformation 
which, when taken in conjunction with untransformed characteristics of the image reproduction system and method, 
results in a reproduced tone mapping having instantaneous gamma values with a prescribed set of properties. This 
produces a reproduction having preferred visual characteristics with respect to tones, but does not address the issues 
of preferred color nor does it provide any method of generating a preferred color reproduction. Such tonal mappings, 

15 when applied to color data represented in an additive RGB type of color space, also result in chroma modifications. 
These chroma modifications are coupled to the tonal mapping and achieve chroma increases only as a consequence 
of luminance contrast increases. There is no provision in such methods for independent control of luminance and 
chrominance mappings. Furthermore tonal mappings such as these introduce uncontrolled hue shifts for most colors 
whenever the tonal mapping deviates from linearity Another limitation of tonal mappings is that there is no ability to 

20 selectively apply the transform to limited regions of the color space. 

[0006] As mentioned above, in contemporary imaging systems, preferred color rendering is often accomplished 
through the use of some form of preferred color mapping that is typically achieved through limited, slow and inflexible 
means. These means include, but are not limited to, modification of tonescates, modifications of selected colors, change 
of dyes or colorants, or manual manipulation of digital images using products such as Adobe Photoshop®. Because 

25 the perception of the light received by the eye and interpreted as a natural image is a very compiex process, the subtle 
color and tonescale changes inherent in natural images are not well accommodated by simple transformations. As a 
result, a myriad of artifacts and unnatural appearing problems occur. These problems can include transitions between 
colors across gradients of hue, chroma, or lightness that are not as smooth or continuous as they appear in the natural 
scene. These transitions may produce artifacts or discontinuities in the image. In additions the calculations necessary 

30 to compute the required transforms are often complex and may require dedicated computational resources and time. 
The time required for accomplishing the calculations often limits the applicability of the methods because they cannot 
be done in real time as images are physically produced and as a result must be done off line or else a substantial 
sacrifice In productivity will result. 

[0007] What is needed is a completely new algorithm that enables colors to be transformed to produce a preferred 

35 color mapping, preferably by moving colors to or toward preferred positions in a color space. Ideally, when natural 
images are processed, gradations in color or between colors should appear as smooth or sharp in the modified images 
as they did in the original. Specifically, continuous transitions should be smooth and continuous and should not produce 
artifacts, discontinuities or contours. In addition, the overall impression of the composition of the image should be such 
that the rendered image is more pleasing than prior to treatment with the algorithm. 

^0 [0008] The present invention is directed to overcoming one or more of the problems set forth above. Briefly summa- 
rized, according to one aspect of the present invention, the invention resides in a method for transforming a file of 
digital color data representing a color image into a new file of digital color data where one or more colors have been 
transformed to one or more new color locations where their reproduction is known to be preferred. The digital color 
data is provided in a multi-dimensional color space where the preferred color locations in the color space are designated 

45 as color magnets. The color space distance is then calculated between the color locations of the digital color data in 
the color space and the color magnets, wherein each color magnet has a predetermined region of influence. A particular 
activity is prescribed for each color magnet that affects color locations in the color space within the region of influence 
of each color magnet. Then, the digital color data is mapped to new locations in the multi-dimensional color space as 
a function of the color space distance and the selected activity, wherein the degree or strength of activity is a function 

50 of the color space distance or direction in color space. More specifically, the aforementioned activities includes such 
activities as attraction, repulsion, shielding and dragging. 

[0009] The advantageous features of this invention are realized when natural images are processed practicing this 
invention. Gradations in color or between colors appear as smooth or sharp in the rendered images as they did in the 
original image. Continuous transitions are smooth and continuous and do not produce artifacts, discontinuities or con- 
55 tours. In addition, the overall impression of the composition of the image is such that the rendered image is more 
pleasing than prior to treatment with the algorithm. In related technical advantages, the time required to process an 
image is minimized because the transformation may be generated in a separate, off-line process and used to calculate 
a three dimensional lookup table that is subsequently used to apply the transformation to images. This can be done 
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because transformations can be constructed that are universally applicable to ail natural images, not just a small sub- 
class of images. Thus in operational use, the required calculations are extremely rapid because they only require the 
application of a single three-dimensional look up table to the pixels in the image. The transformation can be applied 
to images in a high volume digital photofinishing application in real time. 
5 [0010] These and other aspects, objects, features and advantages of the present invention will be more clearly 
understood and appreciated from a review of the following detailed description of the preferred embodiments and 
appended claims, and by reference to the accompanying drawings. 

[0011] FIG. 1 is a schematic illustration of the elements controlling the behavior of a color magnet. 

[0012] FIG. 2 is a diagram of the process for transforming digital color data in accordance with the invention. 
10 [0013] FIGS. 3A and 3B together form a diagram of the process for calculating the color magnets algorithm. 

[0014] FIGS. 4A and B show examples of the effect of an attractive magnet that affects the hue and lightness, as 

shown on CIELab b* versus a* and L* versus C* diagrams, respectively. The colors are indicated by stars before 

application of the color magnets algorithm and by triangles after application of the color magnets algorithm. 

[0015] FIGS. 5A and B show examples of the effect of a repulsive magnet that affects the hue and lightness of green 
15 colors having mid-levels of lightness, as shown on CIELab b* versus a* and L* versus C* diagrams, respectively. The 
- colors are indicated by stars before application of the color magnets algorithm and by triangles after application of the 

color magnets algorithm. 

[0016] FIGS. 6A and 6B show examples of the effect of a dragnet that changes green colors by increasing chroma 
and lightness by 10 and decreasing hue by 20, as shown on CIELab b* versus a* and L* versus C* diagrams, respec- 
20 tively. The colors are indicated by stars before application of the color magnets algorithm and by triangles after appli- 
cation of the color magnets algorithm. 

[0017] FIGS. 7A and B show examples of the effect of a shield that protects skin colors (L* = 50, a # = 25, b* * 25) 
acting on a magnet that modifies chroma and lightness of all hues, as shown on CIELab b* versus a* and L* versus 
C* diagrams, respectively. The colors are indicated by stars before application of the color magnets algorithm and by 

25 triangles after application of the color magnets algorithm. 

[0018] FIG. 8 is a perspective diagram of a computer system for implementing the present invention. 
[0019] Because digital image processing algorithms and systems employing color space transformations are well 
known, the present description will be directed in particular to attributes forming part of, or cooperating more directly 
with, a color space transformation in accordance with the present invention. Attributes not specifically shown or de- 

30 scribed herein may be selected from those known in the art. In the following description, a preferred embodiment of 
the present invention would ordinarily be implemented as software in a computer program. Those skilled in the art will 
readily recognize that the equivalent of such software may also be constructed in hardware. Given the method as 
described according to the invention in the following materials, software not specifically shown or suggested herein 
that would be useful for implementation of the invention is conventional and within the ordinary skill in such arts. More- 

35 over, the computer program may be stored in a computer readable storage medium, which may comprise, for example; 
magnetic storage media such as a magnetic disk (such as a floppy disk) or magnetic tape; optical storage media such 
as an optical disc, optical tape, or machine readable bar code; solid state electronic storage devices such as random 
access memory (RAM), or read only memory (ROM); or any other physical device or medium employed to store a 
computer program. 

40 [0020] This invention relates to a new method that enables colors in an image to be transformed to produce a new 
color mapping for producing images. It is generally used in the field of digital image processing to modify the colors in 
a rendered image, or in a digital image in an intermediate stage of processing, in a way that those viewing the images 
perceive the color to be more preferred. This is accomplished through an algorithm that transforms the color space by 
attracting, or otherwise moving, colors to or toward preferred positions in a color space in a smooth and naturally 

45 appearing manner. The transformation is such that the mapping of colors is accomplished in a smooth and continuous 
fashion that does not produce artifacts, contours or discontinuities in the image and maintains the appearance of the 
image as a natural image. Additionally, in certain specific applications, it is possible to dramatically, and intentionally, 
alter the appearance of an image using color magnets such that the altered image no longer looks like a natural image. 
[0021] The attraction of colors to or toward preferred positions in a color space in a smooth and naturally appearing 

so manner is obtained by an algorithm that utilizes features herein characterized as "color magnets". The color magnets 
transformations described herein are contained in an algorithm that provides a smooth, artifact free means of imple- 
menting preferred color transforms in a color reproduction system. "Color magnets", as used in this disclosure, refers 
to an algorithm designed to produce color transforms through a mathematical transform as described herein. The term 
"color magnets" Is used herein in the sense of an approximate analogy between the physical effects of attraction and 

55 repulsion that physical magnets have on magnetic materials and the effect that the transformation achieved by this 
invention has on values in a color space to or toward or away from a given point in that color space. It is anticipated 
that these transforms will typically be used to produce a preferred color mapping for an image or group of images. 
[0022] In practice, this invention is embodied in an algorithm that allows the user to create a transform that modifies 
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the colors in an image. While it would be feasible to process the digital information representing the colors in an image 
through the algorithm a pixel at a time, this could be a slow process. Consequently, the preferred embodiment comprises 
using the algorithm to produce a multi-dimensional (typically three-dimensional) lookup table of numbers for effecting 
the transformation. The digital information representing the colors in an image are then processed through the lookup 

5 table to produce a new set of digital information representing the desired colors. The algorithm typically works in the 
CIELab/CIELChcolorspacebutcan also be used in any other color space, such as CIELUV color space. The advantage 
of CIElab/CIELCh is that il is an approximately perceptually uniform space, making the results of the transform easier 
to predict. In fact, any multi-dimensional color space may be used wherein the dimensions correspond to perceptual 
attributes of color for human observers, including one or more of lightness, brightness, chroma, colorfulness, saturation 

10 and hue. A detailed description of these color spaces can be found in Color Appearance Models by Mark D. Fairchild, 
Addison-Wesley, (1997). 

[0023] As expressed in Figure 1, the behavior 10 of a color magnet, and the color transformation it produces, is 
controlled by two factors: The region of influence 1 2 of the magnet, that is, the region of color space that the magnet 
influences and, secondly, the effect 14 that the magnet has on colors within its region of influence. While the functional 

15 behavior of a color magnet may be defined such that the region of influence has a definite boundary, it should be 
understood that the region of influence of the magnets is preferably unbounded in extent given the functional behavior 
defined below. In this case, consequently, a region of influence is defined as the region in which the "magnetic effect" 
is greater than a given threshold that would typically cause a visually perceptual change in a color. The region of 
influence of the magnet is in turn controlled by two factors: The location of the center 16 of the magnet and the way 

20 that the color space distance calculation 1 8 is defined for the magnet. The effect that the magnet has on colors within 
its region of influence is in turn controlled by three factors: The type of magnetic behavior 20 ascribed to the magnet 
(i.e. attract, repel, shield or drag) , a function 22 that describes how magnetic effect changes with color space distance 
(as it is defined for that particular magnet) and the strength factors 24 that allow additional control over the direction 
of color change within the color space. 

25 [0024] The overall method for transforming image color using a color magnets transform, in the form of a multi- 
dimensional lookup table, in accordance with the invention is shown in Figure 2. Initially, in step 100 a color space is 
chosen; as mentioned above, the preferred color space is CIELab/CIELCh color space. Then in a step 110, certain 
colors are specified that represent the centers of regions of color space that are to be modified. If an attractive magnet 
is to be specified then this center represents a preferred color position. It may, for example, represent a significant 

30 memory color such as skin color, blue sky or green foliage. (An attractive magnet may be used to modify other colors 
that would not ordinarily be considered significant memory colors; for example, a color magnet may be specified to 
lower the lightness of saturated reds to bring them inside the gamut of photographic paper.) In the case of a repulsive 
magnet then the center would represent an undesirable color, or a color around which color differentiation is to be 
increased. If a shield is to be specified then the color center represents the central color of a region that is to be 

35 protected from change. An example of this might be an average Caucasian flesh color. In the case of a dragnet the 
color center represents the center of a region of color space that we wish to modify. The color magnets are then 
assigned coordinate locations in step 120 that match the location of these preferred colors. Since the color magnets 
exhibit different field characteristics (i.e., attract, repel, shield or drag) that act upon nearby colors, the desired behavior 
of the color magnets is specified in step 130. Attractive and repulsive type color magnets generate a field-like effect 

40 that encompasses and acts upon adjacent colors in the color space. Shield type color magnets exert a protective field 
on adjacent colors with the extent of protection falling off as distance from the magnet center increases. Dragnets can 
be pictured as centers to which adjacent colors are linked by anisotropic elastic bonds. The closer a color is to the 
center of the dragnet, the more strongly it is bound to the dragnet. Colors are also considered to be bound to their 
current locations by similar elastic bonds. The dragnet center is then moved to a new location in the color space, pulling 

45 adjacent colors along with it. Colors closest to the dragnet center, being more strongly bound to it, are dragged closer 
to the new location than colors that were further from the dragnet center. A regular sampling of colors within the chosen 
color space is generated in step 140. This is generally achieved by sampling values (uniformly or otherwise) along 
each of the independent dimensions of the color space and constructing all combinations (a full factorial) of these 
sampled values to create a grid of fully specified colors within the color space. The grid of colors is mapped through 

50 the color magnets algorithm in step 150, resulting in a set of transformed colors within the color space. This set of 
colors, together with the input set of colors can be used to fully define and construct a multi-dimensional lookup table. 
In order to apply the color magnets transform to an image it is only necessary to convert the image to the color space 
chosen in step 1 00 and to map the image through the multi-dimensional lookup table previously constructed (step 1 70). 
[0025] The procedure for using the color magnets algorithm is shown in figures 3A and 3B. In step 200 the locations 

55 and behaviors of the color magnets are defined. The behavior of color magnets has been discussed above. Turning 
now to the location of the center of each magnet, color magnets are assigned a center point location in the working 
color space. In the CIELab/ CIELCh color space for example, the location of the color magnet center is described by 
a set of three numbers - either L^J^or L m CJi m representing either L*, a* and b* or L*. C* and h* , where L* represents 
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lightness, a* represents a red-green chromaticity axis, b* represents a yellow-blue chromaticity axis, C* represents 
chroma, and h* represents hue. Because of the anisotropic behavior allowed to magnets, it can sometimes be mis- 
leading to describe magnet location as a single point in color space. Depending on the way that the color space distance 
calculation is defined, it can sometimes be better to visualize a magnet as a line, a plane or a cylinder rather than a 

s single point, as will be further elucidated in the material on distance calculation below. 

[0026] With regard to the way that the color space distance calculation is defined for the magnet, it should be noted 
that a consequence of the anisotropy of a color space is that color magnets need to be able to display anisotropic 
behavior. In all color spaces the three (or more) dimensions of the color space represent different properties of a color. 
An example of this is the lightness, chroma and hue system. This can be contrasted with a three dimensional geometric 

w space in which all the dimensions represent length. Thus, in the geometric space we expect the same behavior no 
matter which direction we travel within the space (isotropic behavior). In the color space however, if we move along 
the lightness dimension we observe color to change in lightness, while if we move along the hue dimension we would 
see colors change from red to orange to yellow etc at constant lightness and chroma. Accordingly, if we move a color 
a fixed distance higher in the lightness dimension it will become lighter, but if we were to move the same distance in 

15 the hue dimension it may change from red to yellow (anisotropic behavior). 

[0027] Turning now to magnet behavior, as stated above in relation to Figure 1 , the effect that the magnet has on 
colors within its region of influence is controlled by three factors: The type of magnetic behavior ascribed to the magnet 
(i.e. attract, repel, shield or drag), a function that describes how magnetic effect changes with color space distance (as 
it is defined for that particular magnet) and the strength factors that allow additional control over the direction of color 

20 change within the color space. Four types of magnet behavior have been defined in the color magnet algorithm: 

• Attraction - the magnet attracts colors to or towards itself. 

• Repulsion - the magnet repels colors from itself 

• Dragging - the magnet itself moves in the color space, dragging nearby colors along with it. 

25 • Shielding - the effect of the magnet is to shield nearby colors from the effects of other color magnets. 

These behaviors are shown graphically in Figures 4 to 7 for each of the behaviors, respectively, in CIELab a* versus 
b* space and L* versus C* space. 

[0028] Referring again to Figure 3, in step 21 0 the distances between each color and each magnet is calculated. 
30 Anisotropy in the calculation of color space distance is introduced by allowing separate weightings for the three dimen- 
sions of the color space. Thus, in the CIELab/CIELCh color space the distance, d cmi of a particular color at location 
LcSfpc from a magnet at location L m a rr fi m is calculated as follows: 

35 Aa* c , m = aVa% HI 

M* C ^L*-L* mc [3] 
*Fc. m - j(AL* c/tl ) 2 + (AaV m ) 2 + (AbV m ) 2 [4] 

45 



SO 



55 



C* - U* 2 + b* 2 [5] 



^c.m - ^(A£* Ctm ) 2 -(Ar cjn ) 2 -(AC* CiITl) 2 [7] 
<U - hun^cJ + ( w CnAC\J HW^H*^) 2 [8] 
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It is apparent from equation 8 above that the weights w Lmi and can be used to control the anisotropy in the 
calculation of color space distance. Each magnet has its own unique set of weights w^and w H/n and can therefore 
exhibit different anisotropy from other magnets. As an example, consider a magnet for which is set to zero. This 
is a magnet that is insensitive to lightness. The shape of this magnet could therefore be considered as a straight line 
parallel to the L* axis. The distance to colors in the color space therefore depends only on the chroma and hue differ- 
ences between the magnet and the color in question. Another example is a magnet for which both w Lm and w Hm are 
zero. The magnet is therefore insensitive to both lightness and hue. This magnet could be visualized in ClELab space 
as a cylinder, parallel to the L* axis and with a radius equal to the chroma of the magnefs center. 
[0029] Step 220 is the calculation of the magnetic effect field of each color magnet, shield and dragnet on alt colors 
in the image or color set. The effect field of a color magnet, as a function of distance from the color magnet center, can 
be described using any one of a variety of functions. The practical choice of such a function is, however, constrained 
by a need for desirable characteristics for a color magnet mapping. Desirable characteristics include: 

• Mappings are smooth and continuous and, when applied to images, do not result in abrupt transitions or contours. 

• Magnet behavior is predictable and reasonable. That is, magnet effect field is strongest at the location of the 
magnet center and diminishes with distance. At sufficiently large distances the magnet should have no effect field. 

In order to achieve these characteristics, a mathematical function describing the effect field of a color magnet as a 
function of distance should preferably have the following properties: 

• The function has a maximum at a distance of zero. 

• The function decreases smoothly and continuously as distance increases. 

• The function asymptotically approaches zero as distance approaches infinity. 

• The function is always non-negative. 

• The function has a slope of zero at zero distance. 

While a variety of functions may be used that at least approximate the desirable properties mentioned above, the initial 
version of color magnets uses either of the two following functions, both having the properties listed above, to describe 
the magnet effect field, Cf cm at color location c resulting from color magnet m, as a function of distance, d c m . The first 
of these is a pseudo-Gaussian type of function (equation [9j) and the second is an inverse multi-quadric function 
(equation 1*101): 



In equations [9] and [10], o is a parameter that controls the slope and p is a parameter that controls the width of the 
effect field function. The use of a factor of 1 0 p in the denominator of [1 0] is arbitrary and is chosen to make the half 
width of [1 0] similar to that of [9]. 

[0030] At this point (step 230) in the algorithm it is necessary to separate the shields from the other magnets and 
dragnets. This is because of their fundamentally different types of behavior - magnets and dragnets act to move colors 
within the color space while shields act to prevent movement of colors by attenuating the effects of magnets and 
dragnets. 

[0031] Step 240 is the calculation of the effect field of each magnet or dragnet on every other magnet or dragnet. 
This calculation is entirely analogous to that summarized in equations [9] and [10) and is given by equations [11] and 
[12) for the two example effect field functions. 
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[11] 



n 1 im 2 " 



[12] 



to 



1 + 



f5 



20 



25 



In these equations, q^ ^g is the magnetic effect f ield of magnet m 1 on magnet cf m1 ^ is the color space distance 
from magnet m 1 to magnet calculated using the distance an isotropy weightings assigned to magnet m v a m1 is the 
slope parameter assigned to magnet m i and pm 1 is the width parameter assigned to magnet m 1 . 
[0032] In order to ensure smooth and consistent movement of colors within the color space when colors are being 
influenced simultaneously by multiple magnets and dragnets we must perform a normalization of the effect fields. This 
is accomplished in step 250. In general, there will be a set of j magnets all simultaneously acting on all k colors in a 
color set. These j magnets comprise a total of \i attractive and repulsive magnets and r\ dragnets. It is desirable that 
colors that are exactly at the location of an attractive magnet are not moved away by the influence of other magnets. 
This problem is analogous to a multi -dimensional scattered data interpolation problem where it is desirable to reproduce 
data points exactly while interpolating smoothly between them. One simple approach to this problem is the method of 
inverse distance interpolation as discussed in Mathematics of Computation, Volume 38, pp 1 81 - 200, (1 982) by Richard 
Franke. Other interpolation methods described in this reference would be similarly applicable. 
[0033] Following this method, interpolation for attractive color magnets is implemented as follows. The magnetic 
effect field of each magnet on each color is represented by matrix and the magnetic effect field of each magnet 
on each other magnet by matrix P m ^ 



30 



9c, ,m, Qct,m 2 



( le 2 jn J 



[13] 



40 



45 



a in, ,mj 



[14] 



50 (Note: Because each magnet can display unique anisotropy, the matrix P mm is not generally symmetric.) The normal 



ized attraction matrix N c m is then calculated as follows: 



55 



[15] 



The normalized attraction matrix has k rows and /columns as follows: 
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[16] 



10 



15 



20 



In step 260, the total shielding, from the combined effect of all shields, on each color is calculated. The shielding 
behavior of a color to a color magnet, as a function of color space distance between the color magnet center and the 
color, can be described by using a matrix. If there are / shields simultaneously acting on k colors in a color set or image, 
then the shielding effect field on each color by each shield can be represented by the matrix R s m . 



9c, 

9c*,*i 9c kt j, 



9<i.*, 
9c,u, 



[17] 



25 We now calculate the total shielding for each color, c, in the lightness, chroma and hue dimensions. In the 
matrix rofa 'flf.CHci total lightness shielding Is found in column 1, total chroma shielding is in column 2 and total hue 
shielding is in column 3: 



30 



35 



40 



Total i 
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aa\ o-l a») 

i-rRo-*«,.> i-rt^o-o i-EKo-o 



i 
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>-IKo-«*J i-IKa-o 1-IK.0-0 



a -I 



Gel 



[18] 



45 



50 



Total jf _ 
n lCH, ~ 



r u r c % 

% r c t % 



[19] 



The constants A u , A^ and are the strength values of shield a for the lightness, chroma and hue color dimensions 
respectively. 

55 [0034] In step 270 of the method the 'force' of each magnet, accounting for shielding, on each color is calculated. In 
equation [20] the n terms are from the normalized attraction matrix (equation [16]) and the r terms are from the total 
shielding matrix (equation [19]): 
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Steps 280, 290 and 300 of the method describe the calculation of the change in lightness hue and chroma of each 
color due to the action of all of the magnets. The calculations here are slightly different for magnets and dragnets, so 
in step 280 the dragnets are sorted from the attractive and repulsive magnets. 

[0035] Dealing with attractive and repulsive magnets only in step 290 the change in lightness, and chroma and hue 
15 of each color due to the combined action of all of the magnets, allowing for shielding is calculated in the following 
equation [21]: 



20 



25 



ALCH = 



&.4./c^Ai;^ i^^/e^AC;^ f^g^f^AH^ 

<t-1 ami cr»l 

£ga A L.fc ) ».A L ' Ci ^ £g a ^C./ (5 ^,.AC; } ^ i^&A./^Aff*^ 

a=l a«=l obI 

• • > 

* * m 
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In equation [21], u. is the total number of attractive and repulsive magnets and p a takes the value +1 if magnet a is an 
attractive magnet and -1 if magnet a is a repulsive magnet. The constants A^ and A^ are the strength values 
of magnet a for the lightness, chroma and hue color dimensions respectively. The changes in lightness are in column 
1 of the matrix while changes in hue and chroma can be found in columns 2 and 3 respectively. 
[0036] In step 300 the change in lightness, chroma and hue of each color due to the combined action of all of the 
dragnets, allowing for shielding is calculated as follows: 



drttgnm LLCH c = 



n rf tj 

Z/c-A 2X". ac a, IX-.^-. 

flr*l a«l a»l 

7 1 n 

a»J 0al an) 

• ♦ . 

tfc,«.K. tfc^AC',,. if^w.. 



[22] 



In equation [22], y\ is the total number of dragnets. The constants AZ.*,^, AC* TO and AH*^ are the shift (or drag) 
distances for dragnet a in the lightness, chroma and hue color dimensions respectively. 

[0037] The transformed colors are now calculated In step 31 0 according to equation [23] s where, if the original colors 
are represented as LCH, then the new colors LCH' are: 



LCH' = LCH+ ma ^ALCH+ dn0n **&LCH 



[23] 



10 



BNSDOCID:<EP 1139656A1 I > 



EP 1 139 656 A1 

It should be remembered that equation [23] represents vector addition and that hue is a periodic dimension. 
[0038] While the overall methodology of the invention is described above, the invention can be embodied in any 
number of different types of systems and executed in any number of different ways, as would be known by one ordinarily 
skilled in the art. For example, as illustrated in Figure 8, a typical hardware configuration of an information handling/ 

5 computer system in accordance with the invention preferably has at least one processor or central processing unit 
(CPU) 400. The CPU 400 is interconnected via a system bus 410 to a random access memory (RAM) 420, a read- 
only memory (ROM) 430, an input/output (I/O) adapter 440 (for connecting peripheral devices such as disk units 450 
and tape drives 460 to the bus 41 0), a communication adapter 470 (for connecting an information handling system to 
a data processing network), a user interface adapter 480 (for connecting peripherals 490, 500, 51 0 such as a keyboard, 

10 mouse, digital image input unit, microphone, speaker and/or other user interface device to the bus 410), a printer 520 
and a display adapter 530 (for connecting the bus 410 to a display device 540). The invention could be implemented 
using the structure shown in Figure 8 by including the inventive method within a computer program stored on the 
storage device 450. Such a computer program would act on an image frame supplied through the interface units 490, 
500, 510 or through the network connection 470. The system would then automatically produce the desired color space 

15 transformation, which would provide the improved images to the display 540, to the printer 520 or back to the network 
470. In the preferred embodiment, the coefficients for the transformations would be predetermined (precalculated) for 
given magnets at given preferred locations and stored in look up tables in memory such as the disk drive 450. Then, 
the actual conversion of the digital color data would involve accessing the look up tables to determine the transformed 
code value for each input code value. 

20 [0039] When natural images are processed practicing this invention, gradations in color or between colors appear 
smooth or sharp in the rendered images as they did in the original image. Specifically continuous transitions are smooth 
and continuous and do not produce artifacts, discontinuities or contours. In addition, the overall impression of the 
composition of the image is such that the rendered image is more pleasing than prior to treatment with the algorithm. 
The time required to process an image is minimized because the transformation is calculated off line. This can be done 

25 because the transformation is universally applicable to all natural images, not just a small subclass of images. Thus 
in operational use, the required calculations are extremely rapid because they only require the application of a single 
three-dimensional look up table to the pixels in the image. The transformation can be applied to images in a high 
volume digital photofinishing application in real time. 

[0040] The invention has been described in detail with particular reference to certain preferred embodiments thereof, 
30 but it will be understood that variations and modifications can be effected within the spirit and scope of the invention. 



Claims 

25 1. A method of transforming a file of digital color data representing a color image to a new file of digital color data 
where one or more colors have been transformed to one or more new color locations where their reproduction is 
known to be preferred, said method comprising the steps of: 

(a) providing the digital color data in a multi-dimensional color space; 
40 (b) specifying one or more preferred color locations in the color space as one or more color magnets, wherein 

each color magnet has a predetermined region of influence; 

(c) calculating color space distance between one or more color locations of the digital color data in the color 
space and one or more of the color magnets; 

(d) prescribing a particular activity for each color magnet that affects color locations in the color space within 
45 the region of influence of each color magnet; and 

(e) mapping the digital color data to or toward new locations in the multi-dimensional color space as a function 
of the color space distance and the activity, wherein the degree or strength of activity is a function of at least 
the color space distance or direction in color space. 

50 2. The method as claimed in claim 1 wherein said activity specified in step (d) includes at least one activity selected 
from the group including attraction, repulsion, shielding and dragging. 

3. The method as claimed in claim 2 wherein in the activity of attraction the color magnet attracts colors to or toward 
itself. 

55 

4. The method as claimed in claim 2 wherein in the activity of repulsion the color magnet repels colors from itself. 

5. The method as claimed in claim 2 wherein in the activity of shielding the color magnet shields nearby colors from 
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the effects of other color magnets. 



6. The method as claimed in claim 2 wherein in the activity of dragging the color magnet itself moves in the coior 
space, dragging nearby colors along with it in a prescribed and smoothly varying manner. 

5 

7. The method as claimed in claim 1 wherein the preferred color location is selected from the group including a point, 
line, plane, or cylinder in the color space. 



8. The method as claimed in claim 1 wherein the preferred color location is known to a viewer of the color image to 
10 be preferably reproduced in a particular accurate colorimetric manner relative to other renderings of that color. 

9. The method as claimed in claim 8 wherein the preferred color location includes at least one of sky, foliage and 
skin tones. 



15 10. The method as claimed in claim 1 wherein the multi-dimensional color space is ClELab/CIELCh color space. 

11 . The method as claimed in claim 1 wherein the multi-dimensional color space is CIELUV color space 

12. The method as claimed in claim 1 wherein the multi-dimensional color space is any color space wherein the di- 
20 mensions correspond to perceptual attributes of color for human observers, including one or more of lightness, 

brightness, chroma, colorfulness, saturation and hue. 

13. The method as claimed in claim 1 wherein step (c) introduces anisotropic behavior into the calculation of color 
space distance by allowing for separate weightings in one or more of the dimensions of the multi-dimensional color 

25 space. 

14. The method as claimed in claim 1 wherein step (e) introduces anisotropic behavior into the mapping by allowing 
for separate degrees or strengths of activity in one or more of the dimensions of the multi-dimensional color space. 
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